Finding software metrics threshold values using ROC curves
نویسندگان
چکیده
An empirical study of the relationship between object-oriented (OO) metrics and error-severity categories is presented. The focus of the study is to identify threshold values of software metrics using receiver operating characteristic curves. The study used the three releases of the Eclipse project and found threshold values for some OO metrics that separated no-error classes from classes that had high-impact errors. Although these thresholds cannot predict whether a class will definitely have errors in the future, they can provide a more scientific method to assess class error proneness and can be used by engineers easily. Copyright © 2009 John Wiley & Sons, Ltd.
منابع مشابه
Determining optimal threshold values for ‘cumulative sequence count’ and 'overlap percentage
The current document describes the methodology adopted for finding the optimal thresholds for ‘cumulative sequence count' and 'overlap percentage' using ROC curves. For each of the four training data sets, i-rDNA program was executed using various pairs of thresholds for cumulative sequence count and overlap percentage. For each pair of thresholds, the True Positive Rate and the False Positive ...
متن کاملNew approaches to measuring the performance of programs that generate differential diagnoses using ROC curves and other metrics
INTRODUCTION Evaluation of computer programs which generate multiple diagnoses can be hampered by a lack of effective, well recognized performance metrics. We have developed a method to calculate mean sensitivity and specificity for multiple diagnoses and generate ROC curves. METHODS Data came from a clinical evaluation of the Heart Disease Program (HDP). Sensitivity, specificity, positive an...
متن کاملMixtures of receiver operating characteristic curves.
RATIONALE AND OBJECTIVES Receiver operating characteristic (ROC) curves are ubiquitous in the analysis of imaging metrics as markers of both diagnosis and prognosis. While empirical estimation of ROC curves remains the most popular method, there are several reasons to consider smooth estimates based on a parametric model. MATERIALS AND METHODS A mixture model is considered for modeling the di...
متن کاملTechnical Note: Towards ROC Curves in Cost Space
ROC curves and cost curves are two popular ways of visualising classifier performance, finding appropriate thresholds according to the operating condition, and deriving useful aggregated measures such as the area under the ROC curve (AUC) or the area under the optimal cost curve. In this note we present some new findings and connections between ROC space and cost space, by using the expected lo...
متن کاملA Three-Dimensional Receiver Operator Characteristic Surface Diagnostic Metric
Receiver Operator Characteristic (ROC) curves are commonly applied as metrics for quantifying the performance of binary fault detection systems. An ROC curve provides a visual representation of a detection system’s True Positive Rate versus False Positive Rate sensitivity as the detection threshold is varied. The area under the curve provides a measure of fault detection performance independent...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Journal of Software Maintenance
دوره 22 شماره
صفحات -
تاریخ انتشار 2010